Skip to content

[SPARK-9786][Streaming][Kafka] fix backpressure so it works with defa…#8413

Closed
koeninger wants to merge 1 commit into
apache:masterfrom
koeninger:backpressure-testing-master
Closed

[SPARK-9786][Streaming][Kafka] fix backpressure so it works with defa…#8413
koeninger wants to merge 1 commit into
apache:masterfrom
koeninger:backpressure-testing-master

Conversation

@koeninger

Copy link
Copy Markdown
Contributor

…ult maxRatePerPartition setting of 0

@SparkQA

SparkQA commented Aug 25, 2015

Copy link
Copy Markdown

Test build #41519 has finished for PR 8413 at commit 2664626.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@tdas

tdas commented Aug 25, 2015

Copy link
Copy Markdown
Contributor

@koeninger Thank you very very much for debugging and fixing this.
@dragos This was a bug inadvertently introduced in earlier PR.

I am merging this to master and 1.5.

asfgit pushed a commit that referenced this pull request Aug 25, 2015
…ult maxRatePerPartition setting of 0

Author: cody koeninger <cody@koeninger.org>

Closes #8413 from koeninger/backpressure-testing-master.

(cherry picked from commit d9c25de)
Signed-off-by: Tathagata Das <tathagata.das1565@gmail.com>
@asfgit asfgit closed this in d9c25de Aug 25, 2015
@dragos

dragos commented Aug 25, 2015

Copy link
Copy Markdown
Contributor

The rate limiter is using Long.MaxValue, while this one uses 0 as a default. They should both use the same.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants